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Summary 

Previous research has shown that augmented reality can be an 
effective improvement for video based operations. However, the 
problem is whether such a technology can be used with existing 
flight hardware. To answer this question, the Canadian Space 
Vision System (SVS) will be tested as a 3D augmented reality 
system capable of improving human performance where the 
operation requires indirect viewing. This system has already 
been certified for flight and is currently flown on each shuttle 
mission for station assembly. Successful development and 
utilization of this system in a ground-based experiment will 
expand its utilization for on-orbit mission operations using the 
Space Station’s robotic arm. 
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Product 


The proposed project when completed will have a subject 
tested set of symbology operating on flight certified hardware. 
This will be the foundation for performing on-orbit 
experimentation of the use of augmented reality techniques and 
technology. 
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Status 


Phase 1: Modification of SVS software to perform 3D 
overlays using camera positioning and attitude 
information received from a camera positioning 
device. This has been completed successfully. 

Phase 2: Compare a proposed overlay scheme for the 
Automatic Transfer Vehicle to a tested overlay 
scheme from a previous experiment. 36 subjects were 
tested. Each person performed the task with each 
overlay, as well as, without an overlay. Data collected 
was time to completion, accuracy and reversals. 
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Schedule 


Data collection has been completed. Most data reduction and 
analyses have been completed. Final report will be 
completed by the end of the calendar. A presentation will 
given at the Habitat 2004 Conference in January. 
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Results 


Analysis of variance (ANOVA) and post hoc testing of means 
for final alignment error and time for trial completion have 
been completed. Analyses of subject surveys and hand 
controller motion data (reversals and overshoots) are 
underway. 
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Significant Findings (a = 0.05) - Alignment Error 

• All augmented treatments (overlays) decreased final 
alignment error compared with control condition (no overlay). 

• There were no differences in performance among the three 
augmented treatments (overlays). 

• No gender-related differences were found for alignment 
error. 
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Significant Findings (a = 0.05) - Completion Time 

• Completion times with Overlay A were not significantly 
different from those with no overlay. 

• Times to completion with overlays B and C were not 
significantly different from one another, but were 
significantly less than those with Overlay A or no overlays. 

• Completion times were longer for female subjects. 
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Overlay A - previously tested 
overlay in NRA project 
(dynamic overlay aka 
augmented reality) 


Overlay B - proposed ATV 
overlay (graphics only) 
(dynamic overlay aka 
augmented reality) 
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Overlay C. Static Text. 


11/19/2003 


James.Maida@jsc.nasa.gov / Habitat 2004 



SYS system modified and supplied by Neptec 
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Expected Products, etc. 

• HTV symbology objectively tested 

• Flight like SVS system with 3D overlay capability 

• Additional Metrics on the effectiveness of augment 
reality technology for training simulators 

• The SVS system will be available for use in the robotics 
mockup trainers and potentially be an additional resource 
for an NRA project currently underway. 
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Customers 

Regular communication have been underway between MV 
robotics, current users of the SVS system. They anticipate 
the 3D overlay capability to be an enhancement for use with 
SSRMS and with potential use for vehicle docking. 

Communication with robotics group ER has been underway. 
The SVS may be useful for augmented reality technology 
research in the robotics training community. 
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Benefits 


Certain robotic operations are very time consuming because 
of the need for situational awareness. Results show 
augmented reality technology improves this awareness and 
saves time. 

Flight hardware can be upgraded successfully to take 
advantage. This might be especially true for robotic 
operations where geometric information may have more 
utility, i.e. alignment guides, trajectories, etc. 
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